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1 Introduction 



A fundamental problem in finance, economics and management science is to 
determine the optimal time to invest in a project in a random environment 
and to address these types of problems the theory of discretionary stopping 
has been widely employed following Karlin [21]. 

In order to solve some problems of this type we fix a filtered probability 
space, (n, 5", 3^i, P), satisfying the usual conditions and carrying a standard 
one-dimensional (5'f)-Brownian motion, W. We assume that the stochas- 
tic system we study is driven by the Ito diffusion given by the stochastic 
differential equation 



dXt = b{Xt) 
and the functions 6, cr : J — t- I 



dt + (r{Xt) dWt, Xo = xeJ, 



(1) 



satisfy Assumptions 2.1 2.2 



Our objective is to select the (3't)-stopping-time, r, that maximises 



{r<oo} 



where g is subject to the conditions in Assumption 2A and A is a state- 
dependent discounting factor defined by 

At= [ r{Xs)ds, (2) 



for some function r satisfying the conditions of Assumption 2.3 



The majority of financial and economic models in the literature assume 
that the underlying asset's value dynamics are modelled by a geometric Brow- 
nian motion, the associated payoff function is affine and the discounting rate 
is constant. The approach we employ relaxes all these assumptions. 

Considering more general payoff functions allows for utility based decision 
making, which, apart from the work of Henderson and Hobson |19], and 
despite its fundamental importance, has not been widely discussed. 

However, the main benefit of accommodating general payoffs in the mod- 
elling framework is the ability to incorporate compound payoffs into the 
payoff function, such as running payoffs or reversible decisions, as in Johnson 
and Zervos |22j or Guo and Tomecek [18]. For example, consider the case 
where a project is initiated at a cost G{Xt) and provides a running payoff 
given by H{Xt). In this case we have that 



g{X,) = -G{Xp) + Ex, 



e-^'H{Xs) ds 



(3) 
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for a stopping-time p. Here, for example, Xt could represent the demand for 
electricity and H is the 'stack', a discontinuous function, representing the 
price of supplying the demand, or Xt could be the value of an asset that is 
taxed at banded rates, modelled by G and H. In both these, practically im- 
portant, cases g will not be and the classical approach to solving stopping 
problems using variational inequalities cannot be used. 

The framework we present accommodates systems driven by general Ito 
diffusions. This is essential in economics given that not all asset price pro- 
cesses should be modelled by a geometric Brownian motion, which, on av- 
erage, grows exponentially. Beyond decisions driven by prices, extending 
the theory to a wider class of diffusions is important, for example in regime 
switching models such as in Dai, Zhang and Zhu [9] where the driving stochas- 
tic process represents a probability that the market is a bull or bear, and 

j=]o,i[. 

Employing state dependent discounting enables a more realistic mod- 
elling framework for investment decisions in the presence of default risk and 
the events following 2007 have highlighted the importance of including this 
feature in decision making. 

One approach to addressing discretionary stopping problems is through 
dynamic programming and involves a set of variational inequalities. This is 
discussed by, amongst many others, El-Karoui [T3], Krylov Bensoussan 
and Lions Davis and Karatzas pj|, and Guo and Shepp [T7|. The tech- 
nique has become widespread in finance and economics since the introduction 
of so-called 'real options' theory by McDonald and Siegel [3lj, and has been 
described in Merton [32], Dixit and Pindyck [13] and Trigorgis [38]. How- 
ever, taking this approach often involves making strong assumptions about 
the problem data in order to obtain explicit results. 

A different approach has been to employ r(-)-excessive functions, func- 
tions that satisfy 

f{x) > [e-^V(^r)lr<oo] , for X G J. 

This approach has been adopted by Dynkin [T^, Shiryaev [36j, Salminen [35] , 
Alvarez [1] and Lempa [29] , while Dayanik and Karatzas [12] and Dayanik [TT] 
use a certain characterisation of r(-)-excessive functions, as the difference of 
two convex functions, to solve the stopping problem. These techniques, while 
powerful, are technical and are less accessible to a general audience in finance 
and economics unfamiliar with the details of probability theory. 
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Another approach uses martingale theory to locate the optimal bound- 
aries between the stopping and continuation regions and is taken by, for 
example, Beibel and Lerche ([2], [3]), Lerche and Urusov [30], and Chris- 
tensen and Irle |8] and is described informally in Shreve [371 Sec 8.3.2]. This 
approach, while relatively straightforward, is based on assuming the diffu- 
sion starts in the continuation region and considers the first time it hits the 
stopping region. However, as well as relying on the explicit problem data, 
this approach depends on the continuation region existing and an intuitive 
understanding of where it is located. 

The approach we adopt is based on the familiar dynamic programming 
approach while providing the power of the probabilistic techniques. The 
connection between the different approaches is provided by Johnson and Zer- 
vos [2T], where the Ito-Tanaka-Meyer formula is used to analyse the solution 
to the variational inequality as the difference of two convex functions, rather 
than as a function in C^. In using this result, the strong assumptions associ- 
ated with the dynamic programming framework can be relaxed and explicit 
solutions that rely, only, on the problem data can be easily obtained. This 
approach has been taken in Riischendorf and Urusov [3l], Lamberton [27], 
Johnson and Zervos [22] and has been developed fully in Lamberton and 
Zervos [28] . 

The contribution of this paper is to demonstrate how the general theory, 
developed in Lamberton and Zervos [2H], can be applied to obtain explicit 
solutions to a variety of discretionary stopping problems. 

This paper is organised as follows. Section [2] is concerned with a for- 
mulation of the optimal stopping problem and a set of assumptions for our 
problem to be well-posed while in Section [3] we discuss the practical impli- 
cations of these assumptions. In Section |4] we present the methodology for 
identifying the boundaries for six 'elementary' problems and then, in Sec- 
tion [5} we demonstrate how these 'elementary' problems can be employed in 
solving more complex stopping problems. An Appendix provides a proof of 
a key result in solving the problem when a continuation region lies between 
two stopping regions. 
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2 Problem formulation and technical founda- 
tions 

Definition 2.1. Given an initial condition a; > 0, a stopping strategy is any 
pair CBx, r) such that = (f^, 5", 3^t, Px, X, W) is a weak solution to ([T| and 
T is an (?'f)-stopping-time. We denote by S^: the set of all such stopping 
strategies. 

We consider the optimal stopping problem whose value function, v is 
defined by 

v{x) = sup J(S^,r), for X G J, (4) 



where 



{t<oo} 



Here, g is the payoff function and A a discounting function, discussed in 
Section [TJ We shall now set out the Assumptions we require in order that 
this problem is well-posed. 

To start this discussion, recall that in solving this problem through dy- 
namic programming, we would associate the value function v with a function 
w that is the solution to the, so called, Hamilton- Jacobi-Bellman (HJB) 
equation, 

....{loHm + H^W(^) - r(x)u,(x). - =0. X e 1 

(5) 

The solution to the stopping problem involves splitting the interval J into 
the stopping region, 2) C J, and the continuation region, C, with C = J/D. 
For all x G D, in order that (|5| is satisfied, we require that 

g{x) — w{x) = and -a'^ {x)w" (x) + h{x)w'{x) — r{x)w{x) < 0, 

while for all x G C, 

g{x) — w{x) < and -a^{^x)w'\x) ^h{x)w\x) — r{^x)w{x) = 0. 
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To develop an understanding of the general solution of the second-order 
linear homogeneous ODE, which features in dsl), we assume that the data of 
the one- dimensional Ito diffusion, given by (llF in the introduction, satisfies 
the following assumptions. 

Assumption 2.1. The functions 6, a : U — t- M are S(J)-measurable, 

a'^{x) > 0, for all x eJ, 

and 

^ ^ ^ ds < oo and sup cr^(s) < oo, for all a < a < /3 < /3. 

□ 

With reference to Karatzas and Shreve [221 Section 5.5.C], the conditions 
appearing in this assumption are sufficient for the SDE Q to have a weak 
solution Sa; that is unique in the sense of probability law up to a possible 
explosion time, for all initial conditions a; G J. 

Assumption 2.2. The solution of ([T]) is non-explosive. □ 

This assumption means that the boundaries a and /3 are inaccessible to 
the diffusion starting in J, though the boundaries can be entrance boundaries. 

Relative to the discounting factor A, defined by (|2]), we make the following 
assumptions. 

Assumption 2.3. The function r : J — t-JO, oo[ is S(J)-measurable and there 
exists To > such that r(x) > ro, for all a; G J and 

xis) 

ds < oo, for all a < a < /3 < /3. 



a\s) 

□ 



In the presence of Assumptions |2.1| - |2.3| the general solution of the ODE 
appearing in ([s]), 

]^a\x)r\x) + h{x)r{x) - r{x)f{x) = 0, a; G J, (6) 
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exists and is given by 

fix)=A(f){x) + Bilj{x), (7) 

for some constants A,B G M. 

The functions and ip are C^, their first derivatives are absolutely con- 
tinuous functions, 

< (f){x) and < 0, for all x G J, (8) 

< tplx) and ip'ix) > 0, for all x eJ, (9) 

and 

lim0(x) = limiplx) = oo 

In this context, (f) and '0 are unique, modulo multiplicative constants, and 
the Wronskian, W, is defined as 

W(s) := (j){x)^/j' (x) - (f)'{x)^lj{x) > 0, for all x,c G J. 

Also, given any points Xi < 0:2 in J and weak solutions S^^ of the 
SDE ([1]), the functions cj) and ijj satisfy 

0(X2) = 0(xi)E,, [e-^-i] and ^{xi) = ^{x2)E,, , (11) 

where Tz denotes the first hitting time of {z}, 

r. = {t > I Xt = z}. 

All of these claims are standard and can be found in various forms in 
several references, such as Feller |T6], Breiman [6], Ito and McKean |20] . 
Karlin and Taylor [25] , Rogers and Williams [33] and Borodin and Salminen 

In order to be able to address problems where the payoff g is C^, but not 
necessarily C^, we will consider signed measures of cr-finite total variation, 
and we refer to them simply as "measures". Given such a measure, fi, on 
(J, S(J)) we denote the total variation of fi by = /i+ + where /i = 
fi^ — /i~ is the Jordan decomposition of fi. Also, we say that a measure is 
non-atomic if fi{{c}) = 0, for all c G J. 

A function F : J — M is the difference of two convex functions if and only 
if its left-hand side derivative, F'_, exists, is of finite variation, and its second 
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(10) 



distributional derivative is a measure, which we denote by F"{dx). In this 
case we have the Lebesgue decomposition 

F"{dx) = F'^^{x)dx + Fl'{dx), 

where F'^^{x)dx is absolutely continuous with respect to the Lebesgue mea- 
sure and F"{dx) is mutually singular with the Lebesgue measure. On this 
basis, we define the measure LF, related to the ODE (g, by 

LF^dx) = ^a\x)F"{dx) + h{x)Fi{x) dx - r{x)F{x) dx. (12) 
Now, we define the finite variation, continuous processes by 

where V is the local-time process of X at y G J and we have that the 
Ito-Tanaka-Meyer formula gives 



F{Xt) = F{x)+ [ e-^"c?Af^+ [ e-^"or(X„)F(XjrfH^,. 
Jo Jo 



If F is with a first derivative that is absolutely continuous with respect 
to the Lebesgue measure, LF{dx) = £j3^F{x)dx, so that 



Jo Jo 



we are able to recover the familiar Ito formula from the Ito-Tanaka-Meyer 
formula. 

With this in mind and in order to place conditions on our payoff function, 
such that our problem is well-posed and does not involve value functions 
that are infinite, we introduce (0, '?/')-integrable measures. 

Definition 2.2. A measure /i on (J, S(J)) is a (0, ■?/')-integrable measure if 

/ '^{s)\iJi\{ds) + i $(s) |/i|(rfs) < oo, for all 7 e J, 
where the functions $ and \l/ are defined by 

^(x) = . and ^(x^ - 



a2(x)W(x) ' ' a2(x)W(x)' 

□ 
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Necessary and sufficient conditions for a measure /i on (J, S(J)) to be 
(0, '?/')-integrable are ( [281 Theorem 12]) 



^ 1 

—-—\fi\{ds) < oo and 



for all a < a < /3 < /3 and all x G J. 

On this basis, and with reference to 
lowing assumptions on g. 



< oo 



(13) 



Theorem 12], we make the fol- 



Assumption 2.4. The function (7 : J — )■ M is the difference of two convex 
functions, and the measure Lg is (0, '0)-integrable. In addition, g has the 
following limiting behaviour 



lim 



\9{x)\ 



lim 



0. 



(14) 
□ 



3 Implications of the problem formulation 

The framework we adopt accommodates the commonly encountered Ito dif- 
fusions, including, Brownian motion, the Ornstein-Uhlenbeck process, geo- 
metric Brownian motion, the geometric Ornstein-Uhlenbeck process and the 
so-called Feller, square-root mean-reverting, or Cox-Ingersoll-Ross, process 
defined by 

dXt = n{e ~ Xt)dt + a^tdWt, J=]0,oo[, Xq = x G J, 

where k, 6 and a are positive constants satisfying k6 — ^cr^ > 0. This process 
has an entrance boundary at a = 0, and limxiaijix) > 0. When r(x) = r, 
the expressions for the general solutions ([T]) to the ODEs associated with all 
of these diffusions are all well known. In situations where and ip are not 
known, it is possible to approximate them through simulation and employing 



(11) 



Turning our attention to the payoff functions that can be accommodated 
within our framework, we begin by observing that if g is the difference of two 
convex functions and \g\ is bounded by some constant, it will be acceptable. 



Similarly, if g{y) = 00 for some a < y < (3 then (13) will fail. In the case 
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where Mm^iagi^) = oo or lim^^is g{x) = oo, condition (14) of Assumption 



2.4| is a strong test as to the acceptabihty of g. 

For example, consider the case where X is a geometric Brownian motion 
such that 

dXt = bXt + aXtdWt, 

and suppose that r{x) = r > 0, for constants r,b and a. In this case it is 
well known that 

= x"^ and ip{x) = 
where m < < n are given by 

b 



1 



± 



1 



+ 



2r 



If g{x) = x\ j > 0, we need to establish what conditions on the problem 



data result in g satisfying the conditions of Assumption |2.4[ Noting that 
Lg^dx) = L^g{x)dx = x^ - 1) + bj - r j dx, 



in order to establish the second condition in (13), we need to check the 
finiteness of 



e-^'X' dt 



xexp < i jb — j-cr"^ H — J^o"^ — r ) t > E 



dt 



and Lg is (0, '?/')-integrable if 

r>jb+ - 1)(T^. 
This result can be obtained more directly by noting that 



\9ix)\ 



X-' 



X' 



and so, to satisfy (14), we require that 

b 



J < 



+ 



a' 



+ 



2r 
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which can be simphfied to the previous inequahty. 



In fact, (14) will often be tautologous with the requirement that Lg is 



'?/')-integrable, however, the condition (14) is important in that it excludes 



the cases where g{x) = (j){x) or g{x) = ^/'(x). 



With this in mind, under Assumptions 2.1-2.4 and setting 



fi{dx) = —Lg{dx), 

the following results have been established in Johnson and Zervos ^SIJ , John- 
son and Zervos [22] or in Lamberton and Zervos [25] . 
The payoff function g can be expressed analytically as 



9[X) 



(x) / ^{s)/:g{ds) +iIj{x) / $(s)£^(rfs) 

J]a,x[ J[xM 

(x) [ ^is)Lgids)+^Pix) [ ^s)Lgids)], (15) 

J]a,x] J]x,B\ J 



and probabilistically as the r(-)-potential of A specifically 



g{x) = 



e-^' dA^ 



and it satisfies Dynkin's formula, i.e., given any (5't)-stopping times pi < 
P2 < oo. 



E, [e-''^^g{Xp,)] = E,, [e'''^^ g{X,,)] + E,. 



P2 



e dAf' 



pi 



(16) 



In additiion we have a transversality condition, namely, given an increasing 
sequence of (5't)-stopping times (pn) such that lim„_>.ooPn = oo, 

hm E, [e-^- |(7(X,J|l|,„<„o}] =0. 

n— s>oo 

This condition implies that our value function should be finite. 



11 



Furthermore, using (15), we can calculate that 



Noting that 



o'l (x)(l)(x) 


- g{x)(t)'{x) = -W{x) 


1 ^(s)Lq(ds), 

J]x,(3[ 


(17) 


g'_{x)(t){x) 


- g{x)(l)'{x) = -W{x) 


r 

J[x,(3[ 


(18) 




- gix)ij'{x) = W(x) J 


f ^{s)Lg{ds), 

]a,x] 


(19) 


g'_{x)^lj{x) 


-g{x)ip'{x) = W(x) j 


f ^{s)Lg{ds). 

]a,x[ 


(20) 


d 


f9{x)\ g'{x)f{x)- 


-g{x)f'{x) 




dx 




{x) 





we can see that (17-18) are related to the slope of the function g/(f), while 
(19-20) relate to the slope of g/ip- 

Finally, consider a function H : J ^ that is locally integrable with 
respect to the Lebesgue measure and define the measure /i^ on (J, S(J)) by 

^"(T) = J H{x)dx, T E S(J). 
If fi^ is (0, ^/')-integrable, then the function 



h{x) = E,. 



for X G J 



/■oo 

/ e-^'H{Xt)dt , 
.Jo 

is C^, has absolutely continuous first derivative and satisfies 

L,,h{x) + H{x) = 0. 

This result enables problems involving running payoffs, such as those in the 
initialisation example, ([s]), to be tackled. 

4 The solution to six elementary stopping prob- 
lems 



The methodology we employ is based on the results in Lamberton and Zervos 



Section 6], where it is established that under Assumptions 2.1-2.3 and a 



12 



weaker assumption on the payoff, that the value function, v, associated with 
the optimal stopping problem and defined by Q, is of the form 

v{x) = I "^f^^^ + .f " ^ ^ with A,B>0, (21) 

V is r(-)-excessive, and is a solution to the variational inequality 

ma.x{Lv{x), g{x) — v{x)} = 0, xeJ, (22) 
in the following sense. 

Definition 4.1. A function f : J i— )■ M is a solution of the variational in- 
equality ([22|) if v{x) is the difference of two convex functions, the measure 



Lv is (0, ■?/')-integrable, 

—Lv is a positive measure on (J, 3 (J)), (23) 
g{x) - v{x) < 0, for all x G J, (24) 

and 

the measure Lv does not charge the set 6 = {x G J | v{x) > g{x)Y (25) 

□ 

Since Lamberton and Zervos consider only payoffs that are positive, in 
order to accommodate payoffs that are strictly negative, in particular for 
X I a and x t /3, we need the following growth condition on the value function 

\v\<Cil + \g\), (26) 

for some constant C > 0. This condition, which is only relevant for x G C, 
is found in the verification theorem in Johnson and Zervos [22l Theorem 3] 
and replaces (138) in the verification theorem in Lamberton and Zervos pSf 
Theorem 13]. 

This section of the paper presents a methodology for identifying the loca- 
tions of the boundaries between the continuation region, C, and the stopping 
region, D, and as a consequence, the constants A and B. We shall consider 
six elementary cases in all; the cases are 'elementary' in that by combining 
them together, more complex problems can be addressed. 



We start by observing that conditions (23) and (25) reveal immediately 
that if Cg is positive in some interval, then that interval cannot be in the 
stopping region. On this basis we have the first, most basic, two cases. 
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CASE I JZg is positive for all x G J. 



CASE II Lg is negative for all x G J. 

We now consider two more cases constructed by combining Cases |T] and 
Cases |Tl} To appreciate the relevance of the first of these new cases, consider 
the situation when the payoff, g, is such that YrnixiaQix) < and increases 
in such a way that there is a single boundary point, x^, separating the 
continuation and stopping regions, so that C =]a,x^[ and D = [x^,/3[. In 



this situation, by (21) and (26), we must have A = 0. 

In the standard approach, where g is C'^, to specify the parameters B and 
x^, we would appeal to the so-called 'smooth-pasting' condition of optimal 
stopping that requires the value function to be at the free boundary point 
x^. This requirement yields the system of equations 

Bijj{x^) = g{x^p) and Bip'{x^) = g'{x^), 

which is equivalent to 

B = — ^ = — ^ and g(x^) = 0, 

where q is defined by 

q{x) := g{x)ijj'{x) — g'{x)tjj{x) = W{x) / '^{s)Lg{ds), x G J, 



using (19)-(20). We note that g(x^) = corresponds to a a stationary point 



of g/ip. Since x^ G 2), and from (23) we require that Lg{x^} < 0, we have 
the implication that x^ is at either a maximal turning point or a falling point 
of inflection. 

In the more general case that g/ip is not at the free boundary point 
x^, our objective is to find the parameter B such that 

Bip'lx^) < g'_{x^) 
B^{x.^) = g{x^) 
BiIj'{x^) > g'^{x^). 



Rearranging these using (19)-(20) we have that 



/ '^{s)J:g{ds) <0 < I ^(s)£^(c/s) 
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At this point it is worth noting that the measure Lg becomes central to 
obtaining the solution to the stopping problem, just as in Cases [IHITl On this 
basis we present the next two cases. 

CASE III Lg is positive in the interval ]a, Xr[ and negative for all x G [x,., /3[ 
such that there is a maximal turning point of g/tp for some x^, 
with 

77 — V > 777, for all x G J, 

but there is no maximal turning point of (7/0 in J. This case is 
associated with call option type payoffs. 

CASE IV Lg is negative for all x G]a, xi] and positive in the interval /3[ 
such there is a maximal turning point oi g/cj) for some x,^, with 

— ^ > — -, for all X G J, 

0(X<^) 0(X) 

but there is no maximal turning point of g/ip in J. This case is 
associated with put option type payoffs. 

Having constructed Cases III IV] by combining Cases [IHlT[ we construct 



the final two cases by combining Cases III IV 



CASE V Lg is positive for some x G £ :=]a, xz[ U jx,., /3[ and and negative 
for all X G [xi, Xr] such that g/ip achieves a maximal turning point 
for some x^ G [x/, x^] while g/(j) achieves a maximal turning point 
for some x^ G [x^,Xr] with 

9M ^ 9{x) , 9{x^) g{x) n ^ a 

1p{x^) 1p[X) (p[X^) 0(X) 

This case is associated with butterfly option type payoffs. 

CASE VI Lg is negative for all x G £ :=]a;, X;[U Jx,., /3[ and positive for 
some X G [x;,Xr] such that g/cj) achieves a stationary point for 
some X0 g]q;,x/], while g/ip achieves a stationary point for some 
x^ G [xr, (3[, with 

|i„,M£)>M£*) li^i(fl>iM (27) 

This case is associated with straddle option type payoffs. 
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Observe that (17)-(20) imply that Case [V] occurs when we have < x^, 
while Case VI occurs when < x^. 

Case |VI| is important in that it represents situations when the stopping 
problem is one of the first exit time of the diffusion from an interval, rather 
than the the cases when one boundary is inaccessible and the problem is one 
of locating the first hitting time of a point, which characterise Cases |T-V 
Practically this means that the continuation region has two boundaries, one 
on the left hand side, which we shall denote by a, and the other on the right 
hand side, b, and the following conditions need to be satisfied at the two 
boundaries 



A(f)'{a) + B^'{a) < g'_{a) 

A(t){a) + Btp{a) = g{a) 
A(f)'{a) + BiP'ia) > g'^a) 



A<p'{h) + B^'ih) < g'_{h) (28) 
+ Bi){b) = g{h) (29) 
Act>'{h) + Bi,'{h)>g'^{h). (30) 



We note that (28)-(30) mean that the points {a, 6} define maximal turn- 



ing points of the function 



and that 



A(j){x) + Bi){x) 
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for X G J, 



gib) 



1. 



A(j){a) + Bilj{a) A(f){b) + Bilj{b) 

These two observations are important in the martingale approach to solving 
stopping problems (such as in [2], [3], |H]). 

In order to identify the locations of {a,b}, and hence the values for A 



and B, observe that by using (17)-(20), (28)-(|30j) can be rearranged into the 
following set of equations 



20(s) 



,,^[a2(.)W(.; 
,,^[a2(s)W(s; 



Lg{ds) <B< 
Lg{ds) <B< 
Lg{ds) >A> 
-Lg{ds) >A> 



20(s) 



Ms) 
[,,^[ a\s)W{s] 

ms) 



m^) 
aM ^'is)ns: 



Lg{ds) 
Lg{ds) 
Lg{ds) 
Lg{ds). 



(31) 
(32) 
(33) 
(34) 
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These are equivalent to the following system of equations 

g°(a,6)>0 and g^(a,6)<0 



and 



where 



and 



g°(a,6)>0 and g^(a,6)<0, 
2<f){s) 



M c^^(s)W(s 
20(g) 



-Lg{ds) 
-Lg{ds) 
-Lg{ds) 
-Lg{ds) 



20(s) 



-Lg{ds) 



20(s) 



^2(g)W(. 



-Lg{ds) 



2^(s) 



a2(s)W(.) 

2V^(g) 
a2(,)W(.) 

2^(g) 
a2(s)W(.) 



Lg{ds) 
-Lg{ds) 
Lg{ds) 
Lg{ds) 



]a,y] a2(s)W(s 



-Lg{ds), 



-Lg{ds). 



(35) 



(36) 



(37) 



(38) 



(39) 



(40) 



a2(s)W(s) ' ^2(s)W(.) 
We need to strengthen our assumptions on g in order to prove the ex- 



istence and uniqueness of {a, 6} appearing in (35)-(35), this is done, along 



with some explanation, in Lemma A.l in the Appendix. 

We now solve the various control problems described in Cases [T VI by 
constructing explicit solutions of the variational inequalities ( 22 ) that satisfies 



the requirements of (21), Definition 4.1 and (26) 
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Theorem 4.1. Suppose that Assumptions 2. 1\2. 3^^273 and 2.4 hold. We have 



the following solutions to the discretionary stopping problem we have formu- 
lated as CaseslMVA 

Case Given any initial condition a; G J, then the value function v is 
given by v{x) = and G = "3. In this case there is no admissible stopping 
strategy; the optimal stopping time is t* = oo. 



Case Given any initial condition x G J, then the value function v 

is given by v{x) = g{x), D = J and the optimal stopping time is t* =0. 



Case III. Given any initial condition x E J, then the value function v 



is given by 

^(3.) = fB^Pix), ifxeQ =]a,x^[, ^^^^ 
\g{x), i/x G D = 

with B = g{x^)/il){x^) > 0. Furthermore, given any initial condition x G J, 
the stopping strategy (S*,r*) G S^., where S* is a weak solution to ^ and 

T* = inf{t >0 \ XteV}, 

is optimal. 



Case IV, Given any initial condition x E "3, then the value function v 



is given by 

/^(^)' ifxe'D=]a,x^], 
\A0(x), zfxee=]x^,Pl 

with A = g{x^)/(j){x^) > 0. Furthermore, given any initial condition x G J, 
the stopping strategy (§*.,r*) G S^, where S* is a weak solution to III) and 



T* = inf{t > I Xt G 2)}, 

is optimal. 

Case Given any initial condition x G J, then C =]q;, x^[U]X(^, /3[ and 
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the value function v is given by 



B'ijj{x), if X E Qi =]a, 
vix)={g{x), ifxe1) = [x^,x^], (43) 
A(j){x), ifxet2 =\x4„(3[. 

with B = g{x^)/4'{x^) > and A = g{x^) / (p^x^j,) > 0. Furthermore, given 
any initial condition x G J, the stopping strategy (§*., r*) G S^, where S* is 
a weak solution to /fTl) and 



T* = inf{t > I G D}, 

is optimal. 



Case VI. If —Lg is a positive, non-atomic measure on (£,S(£)) and (21) 
is true, then there exist a unique pair (a, 6) G £ such that ^^^-(36) are true. 
In these circumstances, given any initial condition x eJ, then C =]a, 6[ and 
the value function v is given by 

{g{x), if X e Til =]a,a], 

A(j){x) + BiIj{x), ifxee=]a,b[, (44) 
g{x), tfxeV2 = [b,l3l 

with 

^ g{b)ij{a) - g{a)ij{b) 

0(6)^(a)-0(a)^(6)' ^ ^ 

^ g{b)^{a) - g{a)^{b) 

0(a)^(6)-0(6)^(a)- ^ ^ 

Furthermore, given any initial condition x G J, the stopping strategy (S* , r*) G 
§>x, where S* is a weak solution to pp and 



T* = mf{t > I Xt G Di U Da}, 

is optimal. 

We immediately note that for v to be the difference of two convex func- 
tions, we will require continuous fit at the boundaries between the continu- 
ation/stopping regions. This is satisfied by all of (41)-(44). On this basis, 
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the measure Lv will be (0, '?/')-integrable given JZcf) = Lip = and since Lg is 
(0, '?/')-integrable by Assumption 2.4 



Proof of Case |I| The stopping region cannot coincide with any inter- 
val in which Lg is strictly positive, by (23), implying that G = J and (25) 
is satisfied. To satisfy (21) and (26) we require that A = B = 0, implying 
v{x) = 0. Equations (17)-(20) mean that g/ip is increasing (resp., g/cp is 
decreasing) for all x G J, however, this and ( 14 ) in Assumption |2.4 implies 
that g{x) < for all x G U and (24) is satisfied. 



Proof of Case II Since Lg is negative for all x G J, Dynkin's formula 



(16) implies that it would be optimal to stop immediately and that C = 
and (23) is true. Since v{x) = g{x) for all x G J, (24)-(25) and (26) are 



satisfied. 



Note that equations (17)-(20) mean that g/ijj is decreasing (resp.. 



is increasing) for all x G J. This, with (14) in Assumption 2.4 implies that 
g{x) > for all X G J and the value function is strictly positive. 



Proof of Case III 



Observe that as a consequence of Lg being positive 
for all X g]q;,x;[ and negative for all x G [xr,/9[ and (19)-([20|) we will have 
that (3[. In addition, g{x^) /ip{x^) > because g/ip is decreasing 

in ]x^,/3[ and lim^^jsg/ip = 0, the implication being that B > 0. Also, (41) 



satisfies (24) because 



ip{x) ~ i){x^) 



< 



B, for all X G J. 



For V given by (41), (25) is true and, similarly, (23) is true since x^ G [xr.,/3[ 



and Lg < in this interval. Finally, (26) holds since sup^-gef (x) < g{x^) < 
1 + g{x^). 



Proof of Case IV, This is symmetric to Case III Observe that as a conse- 
quence of Lg being negative for all x G]a,x;[ and positive for all x G [x;,/3[ 
and (17)-(18) we will have that x^ G]a,xz] implying, as with Case III 
A = g{x^)/(j){x^) > 0. Since 



0(x) ~ (j){x^) 



< 



A. 



for all X G J, 
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(42) satisfies (24)-(25), (23) is true since GG [xi, I3[ and £(7 < in this 
interval. Finally, (26) holds since sup^gef(x) < g{x^) < 1 + g{x^). 



Proof of Case V, We can regard Case |V] as being composed of (mov- 
ing from a to 13) Case III Case [ill and then Case IV The proof of this case 



is a combination of the proofs of these more elementary cases. 



Proof of Case VI, We begin by noting that Lemma A.l proves the ex- 



istence of a unique pair (a, 6) G £ such that (35)-(36) are true. To see that 



(44) satisfies (24), recall that (35)-(36) imply that the points {a, 6} define 
maximal turning points of the function 



for a; G J, 



and so 



A(t){x) + Bil){x)' 
A(t){x) + Bip^x) > g{x), for all x e G. 



{a,b} G £, while (26) holds since 



Also, for V given by (44), (25) is true and, similarly, (23) is true since 



supf(x) = max{g{a), g{b)} < 1 + ma.x{g{a), g{b)}. 



To see that B > observe that, from (31) 
20(s 



B > 



20(s) 



Lg{ds) 
r£^g{ds) 



20(s) 



Lg{ds) 



>0, 



with the final inequality being a consequence of Lg being negative for all 
X g]q;, x^] and 

since is a maximum turning point of g/(j). Similar arguments show that 
A > 0. 



□ 
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Remark 4.1. The justification for the 'pasting' of intervals in Case\V\ comes 
from Lamberton and Zervos f2R i.e. Theorem 12], where the stopping prob- 
lem is solved for the case of absorbing boundaries with the payoff at the 
boundaries being positive, with the result that the absorbing boundaries are 
in the stopping region. In Case the value function at the boundaries of 
the sub-intervals (x^ andx^) identifies with the payoff and we can regard the 
open interval J being made up of three separate stopping problems on ]a, x.^], 
[x^,^^] and with the diffusion being 'absorbed' at x^ and x^. 



Remark 4.2. Notice that in Cases since it is not a requirement that 



Lg < in the waiting region, it is necessary and sufficient that there are 
maximal turning points at x^ (resp., x^) such that 

— - < — — -, for all X e\a,x^\ 

g{x) g{x^) 
resp., — - < — — r for all x e\x^,/3\ 

(f){x^) 

Remark 4.3. The existence of the stationary points x^ and x^ is sufficient. 



not necessary in Case \V]\ There will be cases when Lg > for some interval, 
but this will not lead to a stationary point of either of the functions g /(f) or 



5 Examples 

We finish with some concrete examples to develop the ideas presented in 
Section |4j In all the examples we shall consider the diffusion, X, is given 
by a geometric Brownian motion with drift 6 = and volatility o = 0.2 and 
there is a constant discount rate of r = 0.01. In this presented in 

Section |3| we have that 

4>{x) = a;2~"\/3 and </)(x) = x^+V^. 

In the first example, we consider a payoff function of the form 

I c, if X < 2 

9{x) = < . , with c > -2, 

X + c — 2, if 2 < X, 
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which satisfies Assumption |2.4[ In this case 



Lg{dx) = 0.0852 -0.01c/(a;), 

where Sy is the Dirac probabihty measure, assigning mass 1 at the point {y}. 

This means that if c > 8, —^g is a positive measure for all x G J and we 
have the conditions of Casejilj If c G [—2, 0] we have the conditions for Case 
|III[ In the event that c G ]0, 8[ , we know we will be waiting at x = 2 since 
'Cg{2} > and while we do not have the specific conditions for Case VI, in 



fact there is no stationary point of g/i/j for c > 1.5, we can infer that the 



value function is going to be of the form (44), since in the cases when we do 
have a stationary point oi g/ip, 



lim 



g{x) 



> 



When c G ]0,8[, the boundaries of the stopping/continuation regions, 
{a, 6}, can be found either by solving the the smooth fit problem 



A(t){a) + B^{a) = c, 
A0'(a) + Bip'{a) = 0, 



A(P{b) + Bij{b) 
A(f)'{b) + B^'{b) 



or by finding the unique {a, 6} such that a 
as and bs solve 



b + c 
and b = b^ 



b^ where 



2<P{s) 



(t2(s)W(s 



-ds + 



2<t>{s) 



a2(s)W(s) 



(s -2)ds = 8 



20(2) 



a2(2)W(2)^ 



(47) 



while and b^ solve 



2^(s) 



(t2(s)W(s 



-ds + 



a^{s)^N{s) 



's -2)ds = 8 



2^(2) 
(t2(2)W(2)' 



(48) 



One benefit of using (47)-(48) over 'smooth fit', is that it is immediately 



obvious that there is no solution with A,B > when c > 8, which is not 
obvious a priori from the four smooth fit equations. To appreciate how this 
method has advantages over the 'martingale approach', see [28t Example 5]. 
Setting c = 2, (47)-(48) can be expressed as 



(m - 1) 2'"-i 



m — 1 m J 2m 



h{b<j))-, 
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and, 



1) 2 



)n-l 



n 



1 



1 

n 



2n 



with 1^ = ^~ ^ i and n = ^ + ^J~^ . By finding the crossing of and Z^, we 
deduce that, in this case, the value function is given by 



vix] 



1.5439x2- 



3 + 0.4578 x^" 



if X G Di 

if X G e = 

if X G D2 



=]a, 0.9350], 
]0.9350,5.2335[ 
= [5.2335, 



Our second example involves two functions that do not satisfy Assump- 



tion |2.4[ but never the less demonstrate the usefullness of considering com- 
plex stopping problems in terms of Cases [I]-[VTj Consider two 'staircase' type 
payoffs, as discussed in Bronstein, et al. [7], 



'0, ifx<2, 

1, if 2 < X < 4, 

4, if 4 < X < 6, 

9, if 6 < X < 8, 

16, if8<x<10, 

^25, iflO<x, 



'0, ifx<2, 

2, if 2 < X < 4, 

4, if 4 < X < 6, 

6, if 6 < X < 8, 

8, if 8 < X < 10, 

10, if 10 < X. 



Since these functions are not continuous, they do not satisfy the condi- 



tions of Assumption 2.4 apart from (14). However, Lamberton and Zervos 



make the observation that any points at which the payoff function is dis- 
continuous will be part of the continuation region, and so it is possible to 
construct a value function that conforms with Definition |4.1 The analysis 



presented in this paper relies on Assumption 2.4 in the widespread use of 



expressions such as (17)-(20), which are applied, for example, in the proof 



of Lemma A.l However the basic intuition of considering the sign of Lg 
and stationary points of the functions g/(j) and g/cp can still be helpful when 
considering these 'staircase' payoff functions. 

There are turning points of g(i^2)/4' at 2, 4, 6, 8 and 10, and we note that 



0.3880 = -(2) < ^(4) < ^(6) < -(8) < -(10) 

ip ip ip ip ip 



1.1.0763, 
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while 



0.7759 = -(2) > ^(4) > ^(6) > -(8) > -(10) 
tp ip %p ip %p 



0.4305. 



These sequences mean that the solution to the two problems are very 
different. With gi there is a global maximum turning point at x = 10, and 
we have Case HIl] with 

1. 1.0763 a;^+v^, if a; G C =]", 10[, 
25, if X G 2) = [10,/3[, 



VAX) 



and (23)-(26) are satisfied. 

Now, with we have the situation of a series of sub-intervals, as described 



in Remark 4.1[ We have Case III in the interval ]0, 2] , Case VI for the intervals 
[2, 4], [4, 6], [6, 8], [8, 10] and Case |ll| for [10, To develop our understanding 
of the four versions of Case VI, define each jump location as j = 4, 6, 8, 10. 
The right-hand boundary of the four intervals must be continuous fit at j, 



while, employing (|28|)-p0|), the left hand boundary will satisfy smooth fit 

) - (j - 



(see also [U Lemma 4]) if 

^'U - 2) 



< 



0'(j - 2) ^ j0(j - 2) - (j - 2)0(j) ■ 

If this condition is not satisfied, we will also have only continuous fit at 
the left hand boundary, {j — 2). In the case under consideration, it can be 
deduced that 2) = {{2}, {4}, {6}, {8}, {10}} and it is easy to establish that 



V2{X 



0.7759x2- 
2, 

0.8263 

4, 

1.8162x^" 
6, 

2.9443 x^- 

8, 

4.1899x^- 
10, 



3 + 0.5272 x^ 



3 + 0.4375x2- 



3 + 0.3868x^ 



3 + 0.3528x2- 



if X G ]a, 2[, 
if X = 2, 
if X G]2,4[, 
if X = 4, 
if X G]4,6[, 
if X = 6, 
if X g]6,8[, 
if X = 8, 
if X g]8,10[, 
if X > 10, 



and (23)-(26) are satisfied. 
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A Finding {a, 6} appearing in (35)— (36) 



Observe that the construction of Case lVII means that we will have a maximum 
turning point oi g/cj) aX and a maximum turning point of g/ip at with 

a < Xfj, < xi < Xr < x^ < (3. (49) 

Also, given g/4> is increasing for s J, a while g/tp is decreasing for x ^ P, 



combined with (20) and (38), and (18) with (39), means that 



and 



g^(a,^)<0, and g^(a,/3)<0. 



ql(xi,Xr) > 0, and q'^{xi,Xr) > 0. 



(50) 



(51) 



Now, for any u &]a,xi[ and v ^]xr, (3[, by decreasing u or increasing v, 
q'^{u,v) and q'^{u,v) will decrease. In addition, because we have maxima of 
g/(j) and g/ip, 

(52) 
(53) 



q^ix^, /3) > 0, and g^(x<^, /3) < 0, 
q^{a,x^) > 0, and q^{a,x^) < 0, 



and we can see that the maximum value that a could possibly take on, is x^, 
while the minimum value b could take on is x^. Similarly, there is a minimum 
value, tr, such that 

g;(tl,V)>0, and ql{t,t)<0. (54) 

and a maximum value, ^,such that 

g;(^,^)>0, and g^(^,^)<0. (55) 

As a consequence of (52)-(55), there exist mappings and such that 

(56) 
(57) 
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a, ^1 I— !■ 



and 



q°^iy, kiy)) > 0, qliy, l^iv)) < 0, with y < l^{y) 
q'^{z,l^{z)) > 0, q'^lzj^lz)) < 0, with z<l^{z). 
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Finding a unique pair (a, b) is equivalent to showing that there exists a unique 
crossing point of and l^, where y = z = a and /</,(?/) = l^piz) = b. 

The first problem with proving this is that if the measure Cg is atomic, 
meaning that / Lg{ds) could be discontinuous. In this case, there would 
be discontinuities in and and we could have the situation described 
in Figure [l| and it is ambiguous where the crossing point of l^f, and is 
(in respect to the second parameter). These issues do not occur if Lg is 
non- atomic in £. 




Figure 1: The effect of an atom in Lg at u*. 



The second problem occurs if there is a significant gap between a;^ and 
resulting in the situation described in Figure |2| there is no actual crossing 

point. These issues do not occur if the boundaries a and (3 are natural, as 

assumed in Lempa [29| i.e. Lemma 2.1]. 
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ll,(lt 




Figure 2: The effect of being too far from x^. 



Lemma A.l. Suppose that Suppose that Assumptions 2. 1\2. 3^^273 and 2.4 
hold. In addition 

1. Lg is non-atomic on E, G J, as defined above, and —Cg is a positive 
measure on (£,!B(£)). 



2. The following two inequalities hold: 



lim^(x) > ^{x^) and lim^(x) > ^{x„ 



(58) 



then there exist a unique pair (a, 6) G £ such that (35)-(36) are true 



Proof: Our aim is to show that there exist unique mappings (56 -(57) 
such that 

g<A(M0, k{u^)) := j ^2(g)-^(g) ^^(^)^^ = 

with < l^{u) and < l^{u) 

and there is a unique crossing point of and Z^, where a = = and 
b = l^{u) = l(f){u), Lg{a) < 0. In order to do this, let us first assume that 
such a and exist, and we shall first prove uniqueness. 
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We begin by noting that since Xfj, < xi < Xj. < x^, the points (a, 6), if 
they exist, will be in £ = 3/[xi,Xr]- 
Now, observe that since 

then 



> for Ujp,l^{u^) e £, 

and similarly from g'<^. 



CK) = - 



> for u^,l^{u^) e £, 

with the inequalities being a consequence of the fact that 'Cg{x) < in £. 
Comparing l'^ and we can see 

U^) ^ 0(x) ^Mx)) Lgjdl^x)) a\l^{x))W{l^{x)) 
l'^{x) (t>{l^{x)) ij{x) Cg{dl^{x)) a\l^{x))W{l^{x))' 

Note that if there is a crossing of and at a — Uij) — and h — l^{u) — 
l^{u) with a < b, 

W ^ 0(a) m ^gjb) a\b)w{b) ^ mm ^ 

V^{a) m m Lg{h) a^{b)W{b) <f>{b) V(a) 

since is a decreasing function while ip is increasing. This means that at 
a crossing l'^{x) > l'^{x) and so if the crossing exists crosses from below 
l^. If this is the only way a crossing can occur, there can only be one such 
crossing. 

We now show that a crossing exists. Noting that, if they cross, then 
crosses from below then the crossing point exists if 

l<t>{'^) < l^C^) and l^{lt) > l^{lt). 
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Let us consider the second inequality. We have that l^{x^) = (3, and so if 
then this will hold. Now, given the definition of £, G 
]a, Xfp] will be true if and only if 



'^{s)Lg{s)ds < 0. 



Recall that (15), that 

-g{x) = (f){x) 

and so 



'^{s)Lg{s)ds + ip{x) / ^{s)Lg{s)ds 



'^{s)Lg{s)ds. 

Also, since is a turning point of g/(j) we can see that 



9 f 



'^{s)J:g{s)ds. 



So 



'^{s)Lg{s)ds= / '^{s)Lg{s)ds 



'^{s)Lg{s)ds 



<0 



with the final inequality being a consequence of the second inequality in (58 ). 
The proof of /(/,(tr) < follows symmetric arguments. □ 

The condition (58) is sufficient, if it does hold it does not mean that the 

crossing point does not exist. 

Remark A.l. In the cases where andip are given by functions such as con- 
fluent hypogeometric functions or cylinder parabolic functions, solving (35)- 
(36) may be difficult. Noting that solving (35)-(36) is equivalent to solving 
l(l>{,x) — l^{x) = and we have expressions for l'^, l'^, the approach taken here 
may facilitate the solution to the problem. 
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